Beat first 4 ingredients at medium speed with an electric mixer until creamy.

Gradually add powdered sugar alternately with Key lime juice, 1 Tbsp. at a time, and 1 Tbsp. milk, beating at low speed until blended and smooth after each addition.

Beat in up to 1 Tbsp. additional milk for desired consistency